Method and apparatus for controlling multi-experience translation of media content

ABSTRACT

A method or apparatus for controlling a media device using gestures may include, for example, modifying media content to generate first updated media content according to a comparison of first information descriptive of a first environment of the source device to second information descriptive of a second environment of the recipient device, capturing images of a gesture, identifying a command from the gesture, and modifying the first updated media content to generate second updated media content according to the command. Other embodiments are disclosed.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of and claims priority to U.S. patentapplication Ser. No. 13/207,927, filed Aug. 11, 2011. All sections ofthe aforementioned application are incorporated herein by reference.

FIELD OF THE DISCLOSURE

The present disclosure relates generally to media content and morespecifically to a multi-experience translation of media content

BACKGROUND

Media content is generally experienced by consumer via media devicessuch as computers, televisions, radios, and mobile electronics. Mediacontent is frequently delivered by service providers, who send mediacontent, such as television programming, radio, and video, directly toconsumers for enjoyment at their physical location. Service providersalso often provide access to the internet and to internet-based mediacontent, such as websites, games, social networking, and virtual-realityapplications. Consumer media content experiences can be affected bytheir sensory environment. Consumers frequently control media devices byway of user interfaces such as keyboards, touch pads, touch screens,mice, input devices, and voice recognition.

BRIEF DESCRIPTION OF THE DRAWINGS

FIGS. 1-2 depict illustrative embodiments of communication systems thatprovide media services;

FIG. 3 depicts an illustrative embodiment of a web portal forinteracting with the communication systems of FIGS. 1-2;

FIG. 4 depicts an illustrative embodiment of a communication deviceutilized in the communication systems of FIGS. 1-2;

FIG. 5 depicts an illustrative embodiment of a system;

FIG. 6 depicts an illustrative embodiment of a system;

FIGS. 7-15 depict illustrative embodiments of methods operating inportions of the systems described in FIGS. 1-6; and

FIG. 16 is a diagrammatic representation of a machine in the form of acomputer system within which a set of instructions, when executed, maycause the machine to perform any one or more of the methods discussedherein.

DETAILED DESCRIPTION

The present disclosure describes, among other things, illustrativeembodiments for controlling media devices by way of gestures. In oneembodiment, video of user movements captured at a media device are usedto identify gestures that correspond to commands to the media device. Inone embodiment, an adaptation of media content based on an environmentof the media device can be further adapted according to agesture-derived command. Other embodiments are contemplated by thepresent disclosure.

One embodiment of the present disclosure includes a media device havinga memory, a media presentation element for presenting media content atthe media device, and an image sensor for capturing images. The mediadevice also includes a processor coupled to the memory, the mediapresentation element, and the image sensor. The processor can beoperable to retrieve a plurality of sensory information descriptive ofan environment of a media device. The processor can also be operable toidentify a plurality of characteristics of the environment of the mediadevice according to the plurality of sensory information. The processorcan further be operable to select a first adaptation for modifying apresentation of media content at the media presentation elementaccording to the plurality of characteristics of the environment of themedia device. The processor can be operable to modify a presentation ofmedia content by the media presentation element according to the firstadaptation to generate a first modified presentation of the mediacontent. The processor can also be operable to capture video of a usermovement at the media device. The processor can further be operable toidentify a gesture from the captured video of the user movement by imagerecognition. The processor can be operable to identify a command fromthe identified gesture. The processor can also be operable to select asecond adaptation for modifying the presentation of the media content atthe media presentation element according to the command. The processorcan further be operable to modify the first modified presentation of themedia content according to the second adaptation to generate a secondmodified presentation of the media content

One embodiment of the present disclosure includes a computer-readablestorage medium having computer instructions that can receive mediacontent from a source device, where the media content includesinformation describing a first environment of the source device. Thecomputer instructions can modify the media content to generate firstupdated media content according to a comparison of the informationdescribing the first environment of the source device and informationdescriptive of a second environment. The computer instructions also cancapture images of a user movement. The computer instructions further canidentify a gesture from the captured images of the user movement. Thecomputer instruction can identify a command corresponding to thegesture. The computer instructions can also modify the first updatedmedia content according to the command to generate second updatedcontent. The computer instruction can further present the second updatedmedia content.

One embodiment of the present disclosure includes a method where mediacontent supplied by a source device is received at a recipient device.The media content is modified to generate first updated media contentaccording to a comparison of first information descriptive of a firstenvironment of the source device to second information descriptive of asecond environment of the recipient device. Images of a gesture arecaptured. A command is identified from the gesture. The first updatedmedia content is modified to generate second updated media contentaccording to the command.

This application is related to U.S. patent application Ser. No.13/185,487, filed Jul. 18, 2011, by Basso et al., entitled “Method andApparatus for Multi-Experience Adaptation of Media Content,” is beingsimultaneously filed forthwith. All sections of the aforementionedapplication are incorporated herein by reference.

This application is related to U.S. patent application Ser. No.13/185,493, filed Jul. 18, 2011, by Basso et al., entitled “Method andApparatus for Multi-Experience Translation of Media Content withMetadata.” All sections of the aforementioned application areincorporated herein by reference.

This application is related to U.S. patent application Ser. No.13/208,037, filed Aug. 11, 2011, by Basso et al., entitled “Method andApparatus for Multi-Experience Metadata Translation of Media Contentwith Sensor Sharing.” All sections of the aforementioned application areincorporated herein by reference.

FIG. 1 depicts an illustrative embodiment of a first communicationsystem 100 for delivering media content. The novel communication system100 can capture a user movement and compare the captured user movementto a set of stored gestures via image recognition. The communicationsystem 100 can also determine if the captured user movement matches astored gesture. If a match is determined, then the novel communicationsystem 100 can retrieve a command corresponding to the identifiedgesture. The communication system can further perform the command. Thecommunication system can collect sensory data characterizingenvironments at a source device and a recipient device. Thecommunication system 100 can compare the environmental characteristicsof the source device with environmental characteristics at the recipientdevice to detect differences. The communication system 100 can use thesedifferences to modify presentation of the media content from the sourcedevice that can be delivered at the recipient device. The communicationsystem 100 can use a command identified from a user movement to controlthe modification of the presentation of the media content.

The communication system 100 can represent an Internet ProtocolTelevision (IPTV) media system. The IPTV media system can include asuper head-end office (SHO) 110 with at least one super headend officeserver (SHS) 111 which receives media content from satellite and/orterrestrial communication systems. In the present context, media contentcan represent, for example, audio content, moving image content such as2D or 3D videos, video games, virtual reality content, still imagecontent, and combinations thereof. The SHS server 111 can forwardpackets associated with the media content to one or more video head-endservers (VHS) 114 via a network of video head-end offices (VHO) 112according to a common multicast communication protocol.

The VHS 114 can distribute multimedia broadcast content via an accessnetwork 118 to commercial and/or residential buildings 102 housing agateway 104 (such as a residential or commercial gateway). The accessnetwork 118 can represent a group of digital subscriber line accessmultiplexers (DSLAMs) located in a central office or a service areainterface that provide broadband services over fiber optical links orcopper twisted pairs 119 to buildings 102. The gateway 104 can usecommon communication technology to distribute broadcast signals to mediaprocessors 106 such as Set-Top Boxes (STBs) which in turn presentbroadcast channels to media devices 108 such as computers or televisionsets managed in some instances by a media controller 107 (such as aninfrared or RF remote control).

The gateway 104, the media processors 106, and media devices 108 canutilize tethered communication technologies (such as coaxial, power lineor phone line wiring) or can operate over a wireless access protocolsuch as Wireless Fidelity (WiFi), Bluetooth, Zigbee, or other present ornext generation local or personal area wireless network technologies. Byway of these interfaces, unicast communications can also be invokedbetween the media processors 106 and subsystems of the IPTV media systemfor services such as video-on-demand (VoD), browsing an electronicprogramming guide (EPG), or other infrastructure services.

A satellite broadcast television system 129 can be used also in themedia system of FIG. 1. The satellite broadcast television system can beoverlaid, operably coupled with, or replace the IPTV system as anotherrepresentative embodiment of communication system 100. In thisembodiment, signals transmitted by a satellite 115 carrying mediacontent can be received by a satellite dish receiver 131 coupled to thebuilding 102. Modulated signals received by the satellite dish receiver131 can be transferred to the media processors 106 for demodulating,decoding, encoding, and/or distributing broadcast channels to the mediadevices 108. The media processors 106 can be equipped with a broadbandport to the ISP network 132 to enable interactive services such as VoDand EPG as described above.

In yet another embodiment, an analog or digital cable broadcastdistribution system such as cable TV system 133 can be overlaid,operably coupled with, or replace the IPTV system and/or the satelliteTV system as another representative embodiment of communication system100. In this embodiment, the cable TV system 133 can also provideInternet, telephony, and interactive media services.

It is contemplated that the present disclosure can apply to otherpresent or next generation over-the-air and/or landline media contentservices system.

Some of the network elements of the IPTV media system can be coupled toone or more computing devices 130, a portion of which can operate as aweb server for providing web portal services over an Internet ServiceProvider (ISP) network 132 to wireline media devices 108 or portablecommunication devices 116.

Multiple forms of media services can be offered to media devices overlandline technologies such as those described above. Additionally, mediaservices can be offered to media devices by way of a wireless accessbase station 117 operating according to common wireless access protocolssuch as Global System for Mobile or GSM, Code Division Multiple Accessor CDMA, Time Division Multiple Access or TDMA, Universal MobileTelecommunications or UMTS, World interoperability for Microwave orWiMAX, Software Defined Radio or SDR, Long Term Evolution or LTE, and soon. Other present and next generation wide area wireless networktechnologies are contemplated by the present disclosure.

Communication system 100 can also provide for all or a portion of thecomputing devices 130 to function as a media content adaptation server(herein referred to as server 130). The server 130 can use commoncomputing and communication technology to perform function 162, whichincludes among things, modification of media content in accordance witha consumer's environment. The novel communication system 100 can capturea user movement and compare the captured user movement to a set ofstored gestures via image recognition. The communication system 100 canalso determine if the captured user movement matches a stored gesture.If a match is determined, then the novel communication system 100 canretrieve a command corresponding to the identified gesture. Thecommunication system can further perform the command. The server 130 canbe used to receive sensory data representing characteristics of anenvironment of a source device, such as one of the media processors 106,media devices 108, or portable communication devices 116. The server 130can also be used to receive sensory data representing characteristics ofan environment of a recipient device, such as another of the mediaprocessors 106, media devices 108, or portable communication devices116. The server 130 can further be used to determine differences betweenthe characteristics of the first and second sensory environments. Theserver 130 can be used to modify a presentation of media contentaccording to the differences between the characteristics of the firstand second sensory environments. The server 130 can further be used toprovide the modified media content to the recipient device over thecommunication system 100. The media processors 106 and portablecommunication devices 116 can be adapted with software functions 164 and166, respectively, to further utilize the services of the server 130. Inone embodiment, the media processors 106 and portable communicationdevices 116 can be adapted to execute software functions 164 and 166,respectively, to collect and report sensory data to the server 130representing characteristics of the environments of the media processors106 and portable communication devices 116, respectively.

FIG. 2 depicts an illustrative embodiment of a communication system 200employing IP Multimedia Subsystem (IMS) network architecture tofacilitate the combined services of circuit-switched and packet-switchedsystems. Communication system 200 can be overlaid or operably coupledwith communication system 100 as another representative embodiment ofcommunication system 100. The novel communication system 200 can beadapted to capture user movements, identify defined gestures matchingthe captured user movements, and retrieve commands corresponding to thedefined gestures. The novel communication system 200 can also be adaptedto collect sensory data characterizing environments at a source deviceand a recipient device and to compare the environmental characteristicsof the source device with the environmental characteristics at therecipient device to detect differences. The novel communication system200 can also be adapted to use these differences to modify presentationof the media content from the source device that can be delivered at therecipient device. The communications system can further be adapted toconvert user movements into commands to control modification of thepresentation of the media content.

Communication system 200 can comprise a Home Subscriber Server (HSS)240, a tElephone NUmber Mapping (ENUM) server 230, and other commonnetwork elements of an IMS network 250. The IMS network 250 canestablish communications between IMS-compliant communication devices(CDs) 201, 202, Public Switched Telephone Network (PSTN) CDs 203, 205,and combinations thereof by way of a Media Gateway Control Function(MGCF) 220 coupled to a PSTN network 260. The MGCF 220 need not be usedwhen a communication session involves IMS CD to IMS CD communications. Acommunication session involving at least one PSTN CD may utilize theMGCF 220.

IMS CDs 201, 202 can register with the IMS network 250 by contacting aProxy Call Session Control Function (P-CSCF) which communicates with aninterrogating CSCF (I-CSCF), which in turn, communicates with a ServingCSCF (S-CSCF) to register the CDs with the HSS 240. To initiate acommunication session between CDs, an originating IMS CD 201 can submita Session Initiation Protocol (SIP INVITE) message to an originatingP-CSCF 204 which communicates with a corresponding originating S-CSCF206. The originating S-CSCF 206 can submit the SIP INVITE message to oneor more application servers (ASs) 217 that can provide a variety ofservices to IMS subscribers.

For example, the application servers 217 can be used to performoriginating call feature treatment functions on the calling party numberreceived by the originating S-CSCF 206 in the SIP INVITE message.Originating treatment functions can include determining whether thecalling party number has international calling services, call IDblocking, calling name blocking, 7-digit dialing, and/or is requestingspecial telephony features (e.g., *72 forward calls, *73 cancel callforwarding, *67 for caller ID blocking, and so on). Based on initialfilter criteria (iFCs) in a subscriber profile associated with a CD, oneor more application servers may be invoked to provide various calloriginating feature services.

Additionally, the originating S-CSCF 206 can submit queries to the ENUMsystem 230 to translate an E.164 telephone number in the SIP INVITEmessage to a SIP Uniform Resource Identifier (URI) if the terminatingcommunication device is IMS-compliant. The SIP URI can be used by anInterrogating CSCF (I-CSCF) 207 to submit a query to the HSS 240 toidentify a terminating S-CSCF 214 associated with a terminating IMS CDsuch as reference 202. Once identified, the I-CSCF 207 can submit theSIP INVITE message to the terminating S-CSCF 214. The terminating S-CSCF214 can then identify a terminating P-CSCF 216 associated with theterminating CD 202. The P-CSCF 216 may then signal the CD 202 toestablish Voice over Internet Protocol (VoIP) communication services,thereby enabling the calling and called parties to engage in voiceand/or data communications. Based on the iFCs in the subscriber profile,one or more application servers may be invoked to provide various callterminating feature services, such as call forwarding, do not disturb,music tones, simultaneous ringing, sequential ringing, etc.

In some instances the aforementioned communication process issymmetrical. Accordingly, the terms “originating” and “terminating” inFIG. 2 may be interchangeable. It is further noted that communicationsystem 200 can be adapted to support video conferencing. In addition,communication system 200 can be adapted to provide the IMS CDs 201, 202with the multimedia and Internet services of communication system 100 ofFIG. 1. It is further contemplated that the CDs of FIG. 2 can operate aswireline or wireless devices. In one embodiment, the CDs of FIG. 2 canbe communicatively coupled to a cellular base station 117 such as shownin FIG. 1, a femtocell (not shown), a WiFi router, a DECT base unit, oranother suitable wireless access unit to establish communications withthe IMS network 250 of FIG. 2.

If the terminating communication device is instead a PSTN CD such as CD203 or CD 205 (in instances where the cellular phone only supportscircuit-switched voice communications), the ENUM system 230 can respondwith an unsuccessful address resolution which can cause the originatingS-CSCF 206 to forward the call to the MGCF 220 via a Breakout GatewayControl Function (BGCF) 219. The MGCF 220 can then initiate the call tothe terminating PSTN CD over the PSTN network 260 to enable the callingand called parties to engage in voice and/or data communications.

It is further appreciated that the CDs of FIG. 2 can operate as wirelineor wireless devices. Although not shown, the CDs of FIG. 2 can becommunicatively coupled to a cellular base station 221, a femtocell, aWiFi router, a DECT base unit, or another suitable wireless access unitto establish communications with the IMS network 250 of FIG. 2. Thecellular access base station 121 can operate according to commonwireless access protocols such as Global System for Mobile (GSM), CodeDivision Multiple Access (CDMA), Time Division Multiple Access (TDMA),Universal Mobile Telecommunications (UMTS), World interoperability forMicrowave (WiMAX), Software Defined Radio (SDR), Long Term Evolution(LTE), and so on. Other present and next generation wireless networktechnologies are contemplated by the present disclosure. Accordingly,multiple wireline and wireless communication technologies arecontemplated for the CDs of FIG. 2.

It is further contemplated that cellular phones supporting LTE cansupport packet-switched voice and packet-switched data communicationsand thus may operate as IMS-compliant mobile devices. In thisembodiment, the cellular base station 221 may communicate directly withthe IMS network 250.

Communication system 200 can include or otherwise be coupled with server130 of FIG. 1 for purposes similar to those described above. It isfurther contemplated by the present disclosure that the server 130 canperform the function 162 and thereby provide a media content adaptationapplication for subscribers associated with CDs 201, 202, 203, and 205.CDs 201, 202, 203, and 205 can be adapted with software to performfunction 170 to utilize and integrate with the multi-experienceadaptation application performed by the server 130. It is furthercontemplated that the server 130 can be an integral part of theapplication server(s) 217, where the application server(s) 217 performsfunction 172, which can be substantially similar to function 162 andadapted to the operation of the IMS network 250.

FIG. 3 depicts an illustrative embodiment of a web portal 302 which canbe hosted by server applications operating from the computing devices130 of the communication system 100 illustrated in FIG. 1. The webportal 302 can be used for managing services of communication systems100-200. A web page of the web portal 302 can be accessed by a UniformResource Locator (URL) with an Internet browser such as Microsoft'sInternet Explorer™, Mozilla's Firefox™, Apple's Safari™, or Google'sChrome™ using an Internet-capable communication device such as thosedescribed in FIGS. 1-2. The web portal 302 can be configured, forexample, to access a media processor 106 and services managed therebysuch as a Digital Video Recorder (DVR), a Video on Demand (VoD) catalog,an Electronic Programming Guide (EPG), or a personal catalog (such aspersonal videos, pictures, audio recordings, etc.) stored at the mediaprocessor 106. The web portal 302 can also be used for provisioning IMSservices described earlier, provisioning Internet services, provisioningcellular phone services, and so on.

It is contemplated by the present disclosure that the web portal 302 canfurther be utilized to manage and provision software applications162-172 of the devices of FIGS. 1-2, respectively, as described earlier.

FIG. 4 depicts an exemplary embodiment of a communication device 400.Communication device 400 can serve in whole or in part as anillustrative embodiment of the devices depicted in FIGS. 1-2. The novelcommunication device 400 can capture sensory data corresponding toenvironmental characteristics at the communication device. The novelcommunication device 400 can transmit the environmental characteristicsto another communication device or to a server 100-200. The novelcommunications device 400 can adapt its graphical user interface toaccount for differences in environmental conditions. The communicationdevice 400 can comprise a wireline and/or wireless transceiver 402(herein transceiver 402), a user interface (UI) 404, a power supply 414,a location receiver 416, and a controller 406 for managing operationsthereof. The transceiver 402 can support short-range or long-rangewireless access technologies such as Bluetooth, WiFi, Digital EnhancedCordless Telecommunications (DECT), or cellular communicationtechnologies, just to mention a few. Cellular technologies can include,for example, CDMA-1X, UMTS/HSDPA, GSM/GPRS, TDMA/EDGE, EV/DO, WiMAX,SDR, LTE, as well as other next generation wireless communicationtechnologies as they arise. The transceiver 402 can also be adapted tosupport circuit-switched wireline access technologies (such as PSTN),packet-switched wireline access technologies (such as TCPIP, VoIP,etc.), and combinations thereof.

The UI 404 can include a depressible or touch-sensitive keypad 408 witha navigation mechanism such as a roller ball, a joystick, a mouse, or anavigation disk for manipulating operations of the communication device400. The keypad 408 can be an integral part of a housing assembly of thecommunication device 400 or an independent device operably coupledthereto by a tethered wireline interface (such as a USB cable) or awireless interface supporting, for example, Bluetooth. The keypad 408can represent a numeric keypad commonly used by phones, and/or a Qwertykeypad with alphanumeric keys. The UI 404 can further include a display410 such as monochrome or color LCD (Liquid Crystal Display), OLED(Organic Light Emitting Diode) or other suitable display technology forconveying images to an end user of the communication device 400. In anembodiment where the display 410 is touch-sensitive, a portion or all ofthe keypad 408 can be presented by way of the display 410 withnavigation features.

The UI 404 can also include an audio system 412 that utilizes commonaudio technology for conveying low volume audio (such as audio heardonly in the proximity of a human ear) and high volume audio (such asspeakerphone for hands free operation). The audio system 412 can furtherinclude a microphone for receiving audible signals of an end user. Theaudio system 412 can also be used for voice recognition applications.

The UI 404 can further include an image sensor 413 such as a chargedcoupled device (CCD) camera for capturing still or moving images. In oneembodiment, the image sensor 413 can be capable of capturing usermovements, such as movements of a user's hands or arms or movements of auser's head, face, or facial features. The image sensor 413 can be builtinto another function of the UI 404. In one embodiment, the image sensor413 can be included in the display 410. In another embodiment, the imagesensor 413 can be a stand-alone device that is communicatively coupledto the UI 404.

The UI 404 can further include an image recognition system 417. Theimage recognition system 417 can compare a user movement captured by theimage sensor to a set of gestures 418 that has been previously stored inthe communication device 400. In one embodiment, the image recognitionsystem 417 can be a computer program or routine. In one embodiment, theimage recognition system 417 can be included in a server 130. The set ofstored gestures can be a set of standard gestures 418 that can beprovided to the device 400. In one embodiment, standard gestures aredownloaded to the communication device 400 from a server 130 of aservice provider over a communication system 100. In one embodiment, aset of standard gestures 418 can be built into the communication device400. In one embodiment, the set of stored gestures 418 can include a setof custom gestures that have been defined on the communication device400 or that have been developed and copied from a similar communicationdevice 400.

After a user movement is captured, the user movement(s) can be comparedagainst the set of stored gestures 418. When the captured user movementmatches a stored gesture, then a command corresponding to that storedgesture is retrieved. For example, a wave of a user's hand can bedefined as a gesture and can further be defined as a means for a user tocommand a closing of an open media file on the communication device 400.In that case, a wave of a user's hand will result in a captured usermovement (video of the hand waving). The image recognition system 417compares the capture user movement to the set of stored gestures 418.When the matching stored gesture (the hand wave gesture) is found, thenthe image recognition system 417 retrieves the pre-defined “close mediafile” command associated with the hand wave gesture.

The power supply 414 can utilize common power management technologiessuch as replaceable and rechargeable batteries, supply regulationtechnologies, and charging system technologies for supplying energy tothe components of the communication device 400 to facilitate long-rangeor short-range portable applications. The location receiver 416 canutilize common location technology such as a global positioning system(GPS) receiver capable of assisted GPS for identifying a location of thecommunication device 400 based on signals generated by a constellationof GPS satellites, thereby facilitating common location services such asnavigation.

The communication device 400 can use the transceiver 402 to alsodetermine a proximity to a cellular, WiFi, Bluetooth, or other wirelessaccess points by common sensing techniques such as utilizing a receivedsignal strength indicator (RSSI) and/or a signal time of arrival (TOA)or time of flight (TOF). The controller 406 can utilize computingtechnologies such as a microprocessor, a digital signal processor (DSP),and/or a video processor with associated storage memory such as Flash,ROM, RAM, SRAM, DRAM or other storage technologies.

The communication device 400 can be adapted to perform the functions ofthe media processor 106, the media devices 108, or the portablecommunication devices 116 of FIG. 1, as well as the IMS CDs 201-202 andPSTN CDs 203-205 of FIG. 2. It will be appreciated that thecommunication device 400 can also represent other common devices thatcan operate in communication systems 100-200 of FIGS. 1-2 such as agaming console and a media player.

Illustrative embodiments of methods that can operate in portions of thecommunication device of FIG. 4 are described below.

FIG. 5 depicts an illustrative embodiment of a system 500 for adaptationof media content in accordance with a user's sensory environment. System500 can be overlaid or operably coupled to communication systems 100-200as another representative embodiment of communication systems 100-200.System 500 can include a server 530 in communication with mediaprocessors 506 (such as set-top boxes), computing devices 512 and 514(such as a laptop computer, tablet, etc.), and wireless communicationdevices 516 (such as mobile phones, smart phones, etc.). The mobiledevices 516 can be communicatively coupled to the server 530 by way of amobility network coupled to the Internet or other communication means.The computing devices 512 can also be communicatively coupled to theserver 530 by way of the Internet or other communication means.

The present disclosure contemplates a server 530 that among other thingsis capable of modifying media content in accordance with a user'ssensory environment. The server 530 can be used to receive first sensorydata representing characteristics of an environment 542 of a firstsource device 516. The server 530 can also be used to receive secondsensory data representing characteristics of a second sensoryenvironment 544 of a first recipient device 514. The server 530 canfurther be used to determine differences between the characteristics ofthe environments 542 and 544 of the first source device 516 and thefirst recipient device 514. The server 530 can be used to receive mediacontent from the first source device 516. The server 530 can further beused to modify a presentation of the media content according to thedifferences between the characteristics of the environments 542 and 544of the first source device 516 and the first recipient device 514. Theserver 530 can further be used to provide the modified media content tothe first recipient device 514 over the communication system 100. In oneembodiment, the first source device 516 can be a wireless or mobilecommunications device coupled to the communications system 100 through amobility network. The first recipient device 514 can be a computingdevice. In one embodiment, a second source device 512 can be a computingdevice while a second recipient device 506 can be a media processor,such as a set-top box, that presents the media content on a displaydevice.

Each of environments 542-548 can comprise sensors 507, 513, 515 and 517to provide server 530 sensor data. The sensors can be virtual orphysical. In an embodiment where the sensors 507, 513, 515 and 517 arephysical sensors, these sensors can utilize technology that provides theserver 530 sensory information that includes without limitationtemperature, weather, lighting, color, images, video, audio, locationinformation, time, season of the year, aroma, and type of establishmentfrom which the source or recipient device is operating. Virtual sensorscan be an integral part of a virtual application operating in the sourceor recipient devices. A virtual application in the present context canrepresent a video game, virtual game such as Second Life™, anapplication including avatars, or a social media application. Thevirtual sensors can also provide the server 530 sensory information suchas temperature, weather, lighting, color, images, video, audio, locationinformation, time, season of the year, aroma, and type of establishmentpresented by the virtual application. Other forms of sensory data such amotion data (velocity, acceleration, etc.), orientation data (e.g.,compass information) and other forms of virtual applications arecontemplated by the present disclosure.

FIG. 6 depicts an illustrative embodiment of a system 600 for collectingsensory data from sense sources operating in the sensory environment ofthe source and recipient devices in accordance with a consumer sensoryenvironment. System 600 can be overlaid or operably coupled tocommunication systems 100-200 as another representative embodiment ofcommunication systems 100-200 or a portion of communication systems100-200. It should be understood, for purposes of this illustration,that the source and recipient devices 644 and 604 are interchangeable,such that the source device 644 and the recipient device 604 can eachcapture or collect sensory data from the environment by way of similarcapabilities as herein described.

The source and recipient devices 644 and 604 can capture sensory datafrom their respective locations by direct or indirect means. The sourceand recipient devices 644 and 604 can be directly coupled to sensors 646and 606. The source and recipient devices 644 and 604 can be adapted tomeasure or sample data from sensors 646 and 604. In one embodiment, therecipient device 604 can use an analog-to-digital convertor to samplevalues at the sensor 420. In one embodiment, the sensor 606 can be asmart device such that sensory data can be captured by the recipientdevice via a digital communication link with the sensor. These sensorscan utilize technology that provides the source and recipient devices644 and 604 sensory information that includes without limitationtemperature, weather, lighting, color, images, video, audio, locationinformation, time, season of the year, aroma, and type of establishmentfrom which the source or recipient device is operating.

The source and recipient devices 644 and 604 can collect sensory datafrom their environment, by indirect means, through communication with asensor data source. Sensor data sources 614, 624, and 634 can besingle-purpose or multi-purpose devices. For example, the recipientdevice 604 can be located near a sensor data source 614 that is astand-alone light sensor. The sensor data source 614 can include asensor 616, such as photodiode, capable of capturing light intensity atthe location. The sensor data source 614 can further include a “smart”capability for capturing a light intensity signal from the sensor 616and converting the light intensity signal to digital data. The sensordata source 614 can include a one-way (sending only) or a two-way(sending and receiving) wireless communication capability 618 forcommunicating the digital light intensity data to other devices, such asthe recipient device 604 by way of a wireless communication capability608 of the recipient device. The sensor data source 614 can be used foranother purpose. For example, the aforementioned stand-alone lightsensor data source 614 can be applied to a building as an input of asecurity system that automatically controls lighting and other securitysettings based on the digital light intensity data reported from thelight sensor data source 614. In this case, the building system securitysystem is the primary user of the light sensor data source 614 while therecipient device 604 can access the digital light intensity data fromthe light sensor data source 614 as a secondary, and perhapstemporarily, when the recipient device 604 is near the location of thelight sensor data source 614. In this way, the recipient device 604 canbenefit from access to light intensity data for use in modifying a mediapresentation without incurring the overhead for sensing light intensity.

Sensor data sources 614, 624, and 634 can be also incorporated intoother devices. In one embodiment, a sensor data source 634 can be amobile communication device, such as a mobile phone. An audio sensor 636(microphone) can be built into a mobile communication device, for use incellular communication. The audio sensor can also be used to capturebackground audio intensity in the environment where the mobilecommunication device is located. In this case, the sensor data source634 has a primary use as a mobile phone and secondary use as a sensordata source for another device, such as the source device 644. In oneembodiment, whenever the mobile phone sensor data source 634 is notbeing used for cellular communication or for other user activities suchas recording audio or video, the audio sensor 636 can be made availablefor use by other nearby devices, such as the source device 644. Themobile phone sensor data source 634 can capture an audio signal from theaudio sensor 636 and convert this into a digital audio signal. In oneembodiment, the digital audio signal can be a “live” audio signal, suchthat it contains a representation of the actual audio occurring at themobile phone sensor data source 634. In one embodiment, the digitalaudio signal can merely be an intensity signal that filters outdiscernable audio content. The mobile sensor data source 634 can sharethe digital audio data with the source device 644 over a mobilitynetwork. In one embodiment, the mobile sensor data source 634 can sharethe digital audio data with another device, such as the recipient device604, by way of an internet link or a wired network.

By receiving sensory data from sensor data sources 614, 624 and 634sharing the same environment, the source device 644 or recipient device604 can collect substantial environmental sensory information. Sharingof sensory data can be via cooperative agreements or opt-in agreementswhere devices are enrolled by their service provider and are obligatedto share sensory data with other devices unless opted out. The sensordata sources 614, 624, and 634 can be other media processors 106 orportable communication device 116 within the communication system 100.

FIGS. 7-8 depict an illustrative method 700-800 that operates inportions of the devices of FIGS. 1-6. Method 700-800 can begin with step702 in which a media device retrieves sensory information from anenvironment of the media device. The media device can be a mediaprocessor 106, such as a set-top box. A media processor 106 can beconnected to the communication system 100 via a gateway 104. A mediaprocessor 106 can deliver media content from the communication system100 to a media device 108, such as a television or a computing device.The media device can be a portable communication device 116, such as acomputing device, wireless computing device, or mobile communicationsdevice, and can receive media content from the communication system 100via a mobility network. The media device can be a source device 512, 516or a recipient device 506, 514. For ease of illustration, the mediadevice will be referenced herein as media device 506, 512 to indicatethat the media device can be either a recipient device or a sourcedevice.

Sensory data can represent an environment 542, 546 of the media device506, 512. Sensory data representing characteristic of the environment ofthe source or recipient device can be derived from a “world” in whichthe device is operating. This “world” can be a physical world or avirtual world. A physical world for a source or recipient device can bedescribed as environmental conditions that can be physically experiencedby one consuming media content at the source or recipient device. Thesensory data can be derived in a physical environment from sensors 507,513, 515 and 517 described earlier. A virtual world for a source orrecipient device can be described as environmental conditions presentedby the source or recipient device for a consumer of virtual content tovirtually experience. Physical and virtual worlds and the collection,distribution, and use of sensory data representing a physical or virtualenvironment are further described below with respect to a media device506, 512.

The physical world can be described as a collection of environmentalconditions and can be assessed by measuring and collecting sensory datarepresenting these environmental conditions. In one embodiment, sensorydata can represent sensory information relating to lighting,temperature, colors, background audio, video, images, and locationdetails, such as room spatial features, time-zone, season, and type ofestablishment (home or commercial enterprise). The media device 506, 512can be described as operating in a sensory environment 548, 546 thatincludes a compilation of sensory data for the physical world of thesource device. In one embodiment, temperature, light intensity, andcolorimetric data, aromatic data, background audio, video, and stillimages, and location information can be collected at the media device506, 512. Sensory data for the sensory environment 548, 546 can becaptured and/or compiled by sensors 507, 513 operating in the mediadevice 506, 512, or by other devices coupled to the communication system100, or by a combination of both. Sensory data can detectcharacteristics, such as sound levels or lighting, that are consistentwith of home or commercial environments to thereby detect and report atype of establishment.

The sensory data of the physical environment for a source device 512,516 can be translated into a standard format before being communicatedto a recipient device 506, 514 or to the media adaptation server 530. Inone embodiment, raw temperature data can be initially collected at thesource device 512, 516 by direct sensing using a thermo probe. The rawtemperature data can be converted into a series of digital readings,statistically converted to a mean temperature or median temperature orrange of temperatures as needed. A single temperature, such as the meanor median, or a temperature range can then be reported from the sourcedevice 512, 516 and received at the recipient device 506, 514, or server530. A similar approach can be used for other sensory data, such aslight intensity, colorimetric data, aromatic data, or volume ofbackground sound or audio.

The sensory data of the physical environment for the media device 506,512 can include audio, video, and still images. For example, a paintingmight appear on a wall at the location of the source device 512, 516.This painting represents a sensory aspect of the physical environmentthat can be replicated exactly or in modified form at a recipient device506, 514. In one embodiment, the painting image can be captured at themedia device 506, 512, by means of, for example, a camera device. Thecaptured image can be saved as an image file, such as a JointPhotographic Experts Group, or JPEG, image file, or as another imagefile format. Similarly, background audio content, such as recorded orlive music or soundtrack, ambient noise, or any combination of soundpresent at the media device 506, 512, can be captured by means of, forexample, a microphone device. The captured sound can be saved as a soundfile, such as a Moving Picture Experts Group, or MPEG, sound file, or asanother image file format. Similarly, background video or a combinationof video and audio or of video, audio, and still images can be capturedat the source device. In one embodiment, a video camera or a combinationof a video camera and microphone could be used to capture video of theenvironment of the media device 506, 512. Video data can be saved asMPEG video files.

The sensory data of the physical environment for the media device 506,512 can include location information. In one embodiment, the location ofthe source device 512, 516 can be captured by accessing GlobalPositioning System (GPS) satellite services. If the media device 506,512 is physically attached to the communication system 100, then itslocation can be determined by reference to the location of otherentities of known locations. In one embodiment, if the media device 506,512 is connected to a router in a building of known location, then thelocation of the building can be reported as the location. If the mediadevice 506, 512 accesses the communication system via a component of amobility network 117, such as specific cell tower, then the location ofthe mobility network component can be used.

The sensory data of the physical environment of a source device 512, 516can be provided to a recipient device 512, 514 or a media adaptationserver 530. The sensory data can be sent as streaming data, files, ormessages. The sensory data can be continuously updated or can beperiodic snapshots of environmental conditions. In one embodiment,temperature can reported each hour or can reported continuously witheach data transmission. Video data can be sent as a continuous stream orcan be converted into a series of still image snapshots to conservesystem bandwidth.

Sensory data representing a virtual “world” of a media device 506, 512can include environmental components that can be experienced virtuallyby one consuming virtual media content at the media device 506, 512. Avirtual world can be an environment that is presented by the mediadevice 506, 512 as part of some type of virtual media content. Virtualmedia content can include video game applications, virtual worldapplications, applications that include avatars, social mediaapplications, and websites. Virtual media content can incorporatescenarios, perspectives, and role-playing attributes that allow aconsumer of the virtual media content to mentally experience variousaspects of another world, persona, or reality. Virtual media content caninclude virtual representations of otherwise physical phenomena, such aslighting, temperature, color, aroma, sound, movement, video, images, andspatial relationships. This “virtual” sensory data imitates physicalphenomena within a virtual context to bring a sense or “realness” to theexperience for the consumer.

Virtual sensory data representing components of the virtual environmentcan be available at the media device 506, 512 as digital data that isaccessed by a video game or virtual world application executing on thesource device. This virtual sensory data for the virtual environment canbe accessible by the game or application from graphics data files, MPEGfiles, JPEG files, and parameter files. The virtual sensory data canalso be accessible to the media device 506, 512 by accessing or parsingthese files as saved in local storage or as made available from anetwork source. The media device 506, 512 can be used as a displaydevice that merely reproduces graphics and audio from a data stream. Insuch a case, the virtual sensory data can be collected by monitoringrun-time data variables available through the operating system of themedia device 506, 512 or available from a graphic card or an audio card.

The sensory data representing the environment of a source device 512,516 can be sent to a recipient device 506, 514 and/or to a server 530.The sensory data can be sent by way of a “pushing” scheme, where data isbroadcast or reported from the source device 512, 516 to the recipientdevice 506, 514 or server 530 as determined by the source device. Thesensory data can be sent by way of “pulling” scheme, where data is onlysent to the recipient device and/or server 530 when requested by therecipient device and/or server.

In step 704, the media device identifies characteristics of theenvironment of the media device 506, 512 corresponding to the sensoryinformation. In one embodiment, the media device 506, 512 can determinea mean value or a range of values for temperature based on capturedtemperature data. The media device 506, 512 can convert captured videointo a standard file format or into a series of still images.

In step 706, the media device 506, 512 selects a first adaptation formodifying a presentation of the media content by the media presentationelement of the media device according to the characteristics of theenvironment of the media device. In step 708, the media device 506, 512can modify the presentation of the media content by the mediapresentation element of the media device according to the firstadaptation. The media presentation element can be a part of userinterface 404 of the media device 506, 512. The media presentationelement can be a combination of hardware and/or software components thatcan allow a user of the device to experience the media content by wayof, for example, seeing, hearing, feeling, or tasting the media contentor a derivative of the media content. For example, the device caninclude software to reproduce video and audio content, encoded as a datafile or a data stream, as video images that are visible on a display 410and as audio that is audible on an audio system 412. The device can haveseveral different media presentation elements. Some of the mediapresentation elements can be specialized to reproduce content only fromspecific formats of media content files or data streams, while othermedia presentation elements can reproduce from several formats orencoding schemes.

The media content can be any combination of text, audio, still images,video, three-dimensional images and video, graphics, orcomputer-generated media, and virtual gaming or avatar-based content.The media content can be associated with television programming, movies,concerts, news, books, articles, audio communication, text messaging,SMS, instant messaging, weather reports, programming information,community information, captioning, video game applications, virtualworld applications, applications including avatars, social mediaapplications, and websites. The media content can originate at a sourcedevice 512, 516 or from service provider(s) of the communicationnetworks 100-200. A service provider can provide limited services, suchas only providing media programming, or can provide broad-basedservices, such as media programming, cellular phone, internet access,and on-demand services. These services can serve as an originating pointfor all or part of the media content at a source device 512, 516.

The media device 506, 512 can modify characteristics of a display 410 ona user interface 404 of the media device or of a user interface, such asdisplay 508, in communication with the media device. For example, themedia device 506, 512 can be located in dark conditions. The mediadevice 506, 512 can detect the environment and adjusts settings on thedisplay 404, 508, such as brightness, backlighting, or contrast. Themedia device 506, 512 can adjust an audio system 412 to account forbackground noise at the media device.

If the media device 506, 512 detects a user movement in step 710, thenthe media device can capture video of the user movement at the mediadevice in step 712. In one embodiment, an image sensor 413 of a userinterface 404 can be capable of capturing user movements. Movements of auser's hands, arms, head, face, or facial features can be captured. Fullbody movements, such as standing up, sitting down, walking, or jumpingcan be captured. The captured user movements can be associated withdefined gestures that can be detected by the media device 506, 512. Forexample, a user movement of standing can be defined as a gesture thatcan command the media device 506, 512 to shut down the media device orto put the media device into a standby state. Alternatively, a usermovement of standing can be an undefined movement that is not to beinterpreted as a gesture by the media device 506, 512.

In step 714, the media device 506, 512 compares the captured video ofthe user movement at the media device to a set of gestures 418. In oneembodiment, an image recognition system 417 in the media device 506, 512can compare a user movement captured by the image sensor to a set ofgestures 418 that has been previously stored in the media device. In oneembodiment, the image recognition system 417 can be a computer programor routine. In one embodiment, the image recognition system 417 can beincluded in a server 530. In one embodiment, the image recognitionsystem 417 can compare the captured video of the user movement to theset of stored gestures 418 by comparing the captured video stream topreviously captured video streams for each gesture. In one embodiment,the captured video can be compared to still images, or screen captures,of the stored gestures. In this case, the gestures are stored as one ormore still images. In one embodiment, the capture video of the usermovement can be converted to one or more still images that representcharacteristic components of the user movement. The one or more stillimages of the captured video of the user movement can then be comparedto one or more stored still images of the gestures.

The set of stored gestures 418 can be a set of standard gestures thatcan be provided to the device 400. In one embodiment, standard gesturesare downloaded to the media device 506, 512 from a service provider overa communication system 100. For example, the standard gestures aredownloaded to the media device 506, 512 using a server 530. In oneembodiment, a set of standard gestures 418 can be built into the mediadevice 506, 512.

The standard gestures 418 can be in the form of a standard gesturelibrary. In one embodiment, standard gestures can be distinct, elementalmovements that can be combined to create more complex standard gesturesin a way that mimics how words can be made from letters or how sentencescan be made from words. For example, a pointing an index finger can be afirst elemental movement that defines a first gesture. Moving a pointedindex finger from left to right can be a second element movement thatdefines a second gesture. These first and second elemental movements canfurther be combined into a third gesture where the index finger ispointed and then is moved from left to right. In this example, the firstgesture (pointing an index finger) can be defined as a selection gesturethat can initiate a first command for the media device 506, 512 toselect an object or file using the user interface 404. The secondgesture (moving a pointed index finger) can be defined as a movementgesture that can initiate a second command for the media device 506, 512to move a previously selected object or file using the user interface404. The combination, or third, gesture (pointing the index finger andthen moving the pointed index finger from left to right) can be definedas the combination of the first and second commands such that an objector file is selected and then moved based on the recognition of this usermovement as the third gesture. In one embodiment, the combinationgesture can initiate a command that is different from the merecombination of the elemental commands.

The standard library of gestures can be directed to functions thatcontrol the user interface, manipulation of media content, and/or accessto the media device 506, 512. For example, standard library gestures canbe defined for navigation gestures, such as opening file folders,scrolling, selecting content, changing user interface windows, zooming,pinning applications or content, or traversing directories. Standardlibrary gestures can be defined for retrieving or disposing documents,including selecting, moving, copying, opening, and printing documents.Standard library gestures can be defined for graphical functions such asdrawing, selecting, moving, sizing, filling, and editing graphicalobjects.

In one embodiment, the set of stored gestures 418 can include customgestures that can be defined on the media device 506, 512 or that can becopied from other media devices. In one embodiment, the media device506, 512 can allow a user to associate elemental gestures or combinationgestures from a standard gesture library with commands that differ fromthe commands defined in the standard gesture library. For example, theaforementioned gesture of pointing an index finger can be re-defined bythe user to initiate a drawing command on the user interface 404. Inanother example, the combination gesture of pointing the index fingerand then moving the pointed index finger from left to right can bedefined as selecting and moving an object or file but can add anadditional command of opening the object or file the location to whichit has been moved. In one embodiment, the media device 506, 512 cansupport a custom gesture function that can capture a new user movementand assign this captured movement to an existing command or a newcommand. The new user movement can then be stored as a custom gesture.

Custom gestures can be modified entirely new gestures or versions ofstandard gestures. Custom gestures can be user-created gesture,combinations of standard gestures, combination of standard gestures withuser-created gestures or combinations of user-created gestures. Customgestures can use, combine, or alter standard commands. Custom gesturescan be used to invoke canned communications. Custom gestures can be usedto request or to command changes in how a media presentation ismodified, translated, or adapted by a media presentation element or auser interface of the media device 506, 512.

Secret gestures can be included in the library of gestures 418 for themedia device 506, 512. The secret gestures can be standard librarygestures or can be custom gestures defined using the media device 506,512. Secret gestures can be “secret” based on the ability of the user toinitiate commands or communications that are concealed from others. Forexample, a specific movement, such as scratching the nose with two slowsimultaneous blinks, can correspond to a custom gesture created by theuser. When this secret gesture is detected, the media device 506, 512can retrieve a secret command. For example, the media device 506, 512can retrieve a command to send a canned message, such as “What's up?” toa known party. In one embodiment, secret messages can be directed tocommands to control access to the media device 506, 512. For example,secret gestures can be used to login, logout, switch users, shut off adisplay for privacy, or shut down the media device. In one embodiment,secret gestures are directed to canned communications to over mediadevices 506, 512 or computing devices 108, 116. Secret gestures caninitiate communications between colleagues and friend over email, socialnetworking, or instant messaging. The secret gesture allows a user ofthe media device 506, 512 to communicate privately without the messageappearing on the media device.

If the captured user movement matches a stored gesture in step 716, thena command corresponding to that stored gesture is retrieved in step 802.In one embodiment, the gestures and commands are in the same file orstream. In one embodiment, a video stream of a stored gesture caninclude the corresponding command as metadata in the stream. In oneembodiment, a still image of a stored gesture can include the command inthe file. In one embodiment, the gesture data and the command data canbe stored and accessed from a common data base. In one embodiment, thecommands and gestures are stored separately. When the captured videomatches a stored gesture, then the corresponding command is retrievedusing an index or other code associated with that stored gesture.

In step 804, the media device 506, 512 can select a second adaptation ofthe user interface of the media presentation element to modify thepresentation of the media content according to the command to the mediadevice. In step 806, the media device 506, 512 can modify the firstmodified presentation of the media content according to the secondadaptation. In one embodiment, a gesture can be used to initiate acommand that will alter the performance of the user interface 404. Forexample, at the beginning of a presentation of a television program onthe user interface 404 of the media device 506, 512 a first adaptationcan be made by the media device, based on the characteristics of themedia device environment, as described in step 708. For example, themedia device 506, 512 can select low backlighting and low audio volume.During the presentation, however, the user can decide that the audiovolume needs to temporarily be muted. The user can make a “mute” gestureby, for example, placing index finger to lips (i.e., the universal“quiet” gesture). The media device 506, 512 can capture and compare theuser's movement to the standard and custom libraries. When the mediadevice 506, 512 finds a matching “quiet” gesture, the media device 506,512 can retrieve a command to mute the volume on the user interface 404.

FIG. 9 depicts an illustrative method 900 that can operate in portionsof the devices of FIGS. 1-6. The method 900 can be used to generate acustom command at the media device. Method 900 can begin with step 902in which a media device 506, 512 can capture video of a user movement atthe media device. In one embodiment, the user can cause the media device506, 512 to enter a gesture programming mode. During gesture programmingmode, the user can teach the media device 506, 512 a new gesture byperforming a movement that is captured by the media device.

In step 904, the media device can identify a command provided at themedia device. In one embodiment, a command selection and entry form ispresented to the user via the user interface 404 of the media device506, 512. The user can select a command from a listing of standardcommands. The user can edit a standard command to create a customcommand.

In step 906, the media device associates the captured video of the usermovement with the identified command to generate a custom gesturecorresponding to the command. After the new gesture is captured by themedia device 506, 512, the user associates a command with the newgesture.

FIGS. 10-11 depict an illustrative method 1000 that operates in portionsof the devices of FIGS. 1-6. Method 1000 can begin with step 1002 inwhich a recipient device 506, 514 can receive sensory data representingcharacteristics of an environment of a source device 512, 516. Therecipient device 506, 514 can be a media processor 106, such as aset-top box. The media processor 106 can be connected to thecommunication system 100 via a gateway 104. The media processor 106 candeliver media content from the communication system 100 to a mediadevice 108, such as a television or a computing device. The recipientdevice 506, 514 can be a portable communication device 116, such as acomputing device, wireless computing device, or mobile communicationsdevice, and can receive media content from the communication system 100via a mobility network. As with the recipient device 506, 514, thesource device 512, 516 can also be a media processor 106, such as aset-top box, and can be connected to the communication system 100 via agateway 104. The source device 512, 516 can be a portable communicationdevice 116, such as a computing device, wireless computing device, ormobile communications device, and can receive media content from thecommunication system 100 via a mobility network. Sensory data canrepresent an environment 542, 546 of the source device 512, 516 or anenvironment 544, 548 of a recipient device 506, 514.

In step 1004, the recipient device 506, 514 can retrieve sensoryinformation from an environment of the recipient device. The sensoryinformation can represent a physical world or a virtual world of therecipient device. The sensory information can be collected anddistributed similarly as the sensory data can be collected anddistributed for a source device 512, 516, as described above. In oneembodiment, the recipient device 506, 514 can capture temperature databy way of a temperature probe or can capture video data by way of acamera, as described above. In step 1006, the recipient device 506, 514can identify characteristics of the environment of the recipient devicefrom the retrieved sensory information. In one embodiment, the recipientdevice can determine a mean value or a range of values for temperaturebased on captured temperature data. The recipient device can convertcaptured video into a standard file format or into a series of stillimages.

In step 1007, the recipient device 506, 514 can determine differencesbetween the characteristics of the environment of the source device 512,516 and the characteristics of the environment of the recipient device.The recipient device 506, 512 can compare the set of characteristicsrepresenting the environment of the source device 512, 516 with the setof characteristics representing the environment of the recipient device.The recipient device 506, 514 can compare, for example, a physicalenvironment at the source device 512, 516 with a physical environment atthe recipient device 506, 514 by comparing the sensory data from eachdevice. For example, the source device 512, 516 may report brightlighting conditions, such a sunshine, as exhibited by lighting intensitysensory data. By comparison, the recipient device 506, 514 may haveidentified low-level lighting conditions based on a cloudy day ornighttime or poor indoor lighting. The recipient device 506, 514 cancompare the lighting conditions as like categories and detect thedifferences. Similarly, the recipient device 506, 514 can compare all ofthe other reported or identified physical sensory data for the twodevices, such as temperature, background audio, location, and the like.

In one embodiment, the recipient device 506, 514 can detect thatbackground walls at the location of the source device 512, 516 aredifferent than those at the location of the recipient device. Therecipient device 506, 514 can detect that the background walls at thelocation of the source device 512, 516 are smaller or shaped differentlythan those at the location of the recipient device. The recipient device506, 514 can detect that the time zone at the location of the sourcedevice 512, 516 is different than the time zone at the location of therecipient device. The recipient device 506, 514 can detect that thesource device 512, 516 is located at tropical latitude while therecipient device is located in a four-season climate that is currentlyexperiencing winter conditions.

The recipient device 506, 514 can compare value or numerical-basedsensory data, such a temperature or light intensity or locationcoordinates. The recipient device 506, 514 can also comparecontent-based sensory data, such as video, audio, or still image contentto determine differences and can establish where these differences areattributable to the physical environments of the source device 512, 516and the recipient device 506, 514. The recipient device 506, 514 canalso compare presentation resources of the recipient device to those ofthe source device 512, 516. In one embodiment, the source device 512,516 may have sophisticated surround sound audio resources, while therecipient device 506, 514 has stereo audio presentation resources.Additionally, the source device 512, 516 may have a high definitiondisplay resource, while the recipient device 506, 514 has a standarddefinition display resource.

In addition to comparing physical environments, the recipient device506, 512 can compare virtual environments. In one embodiment, sourcedevice 512, 516 can be presenting a virtual-reality video game whilerecipient device 506, 514 can be presenting a virtual applicationfeaturing avatars and virtual persons. The source device 512, 516 andrecipient device 506, 514 can each be presenting a different virtualworld, each with a virtual environment made up of many characteristics,to the users of the respective devices. The recipient device 506, 512can compare the set of characteristics representing the virtualenvironment of the source device 512, 516 with the set ofcharacteristics representing the virtual environment of the recipientdevice In one embodiment, the source device 512, 516 may report virtualconditions of out-of-doors, darkness, and a storm in the virtual-realitygame as exhibited by sensory data of virtual lighting intensity orvirtual precipitation or virtual wind. By comparison, the recipientdevice 506, 514 may have identified low-lighting, but calm, indoorconditions, in the avatar-based game. The recipient device 506, 514 cancompare the virtual lighting, weather, and location conditions as likevirtual categories and detect differences. Similarly, the recipientdevice 506, 514 can compare all of the other reported or identifiedvirtual sensory data for the two devices, such as aroma, backgroundaudio, images, and the like. The recipient device 506, 514 can determinedifferences and can establish where these differences are attributableto the virtual environments of the source device 512, 516 and therecipient device 506, 514.

In addition to comparing physical-to-physical and virtual-to-virtualenvironments, the recipient device 506, 514 can also comparephysical-to-virtual and virtual-to-physical environments. In oneembodiment, the recipient device 506, 514 can compare, for example, aphysical environment reported from the source device 512, 516 with avirtual environment presented at the recipient device 506, 514 bycomparing the environment characterizations of each device. Acharacteristic of the virtual environment presented on recipient device506, 514 can be adapted to imitate a real-world, physical characteristicbeing experienced at the source device 512, 516. In one embodiment, thesource device 512, 516 can be at a location experiencing a passing trainthat can be heard as audio and felt as vibration. Characteristics ofaudio and/or vibration can be reported from the source device 512, 516,such as by an audio MPEG file, a background noise measurement(frequency, amplitude), or a vibration reading (frequency, amplitude).The recipient device 506, 514 can compare the reported physical sensorydata to characteristics of the virtual world presented by the recipientdevice. The virtual world, for example, can be presenting a noisyrestaurant where characteristic components of noise and vibration havebeen simulated. The recipient device 506, 514 can compare the noise andvibration between the physical world where a train is passing and thevirtual world of the restaurant and detect differences that can beimportant to adapting a media presentation from a physical location ofthe source device 512, 516 to the virtual “location” of the recipientdevice.

In step 1008, the recipient device 506, 514 can receive media contentfrom the source device 512, 516. The media content can be a combinationof content sourced from the service provider and content generated ormodified by the source device 512, 516. The media content can bereceived by the recipient device 506, 514 directly from the sourcedevice 512, 516, can be received by the recipient device 506, 514 fromthe service provider networks 100-200, or can be received by therecipient device 506, 514 from the server 530.

In step 1009, the recipient device 506, 514 can select a firstmodification of a presentation of the media content according todifferences between the characteristics of the environment of the sourcedevice 512, 516 and the characteristics of the environment of therecipient device 506, 514. In one embodiment, the recipient device 506,514 can adapt a user interface 404 of the recipient device 506, 514according to a difference, or combination of differences, between thecharacteristics of the environments of the source device 512, 516 andthe recipient device. The recipient device 506, 514 can modifycharacteristics of a display 410 on a user interface 404 of therecipient device 506, 514 or of a user interface, such as display 508,in communication with the recipient device. In one embodiment, thesource device 512, 516 can be located in bright conditions, while therecipient device 506, 514 is located in dark conditions. The recipientdevice 506, 514 can detect the difference in environment and adjustssettings on the display 404, 508, such as brightness, backlighting, orcontrast. The recipient device 506, 514 can adjust an audio system 412to account for difference in background noise between the recipientdevice and the source device 512, 516.

In one embodiment, the recipient device 506, 514 can modify the userinterface 404 to account for differences between physical and virtualworlds or between two virtual worlds. In one embodiment, a user of thesource device 512, 516, such as computing device, can be watching amusic video within a virtual reality, avatar-based application presentedon the computing device (e.g., the user's avatar is watching the video).The user can decide to share this virtual experience with someone elsevia a recipient device 506, 514 in the form of a mobile phone. The userof the user of the source device 512, 516 can initiate a sharing of themusic video content with the user of the recipient device 506, 514 by,in one embodiment, sending a text with a link that directs the recipientdevice 506, 514 to the source device 512, 516. The recipient device 506,514 can receive the music video (media content) from the source device512, 516 along with sensory data representing the virtual environmentthat the source device 512, 516 is presenting. The recipient device 506,514 can compare the received, virtual environment characteristics of thesource device 512, 516 with retrieved and identified characteristics ofthe physical environment of the recipient device 506, 514. The recipientdevice 506, 514 can determine, for example, that the virtual worldpresentation of the music video includes a background sound of a virtualfountain. The recipient device 506, 514 can alter the audio system 412of the mobile phone to account for the presence of the fountain at thesource device 512, 516 either by adding a fountain sound to areproduction of the music video through the mobile phone audio system412 (to share the complete experience of the source device user) or byreducing the playback volume of the music video through the audio system(to account for a quieter listening environment for the recipient deviceuser).

The recipient device 506, 514 can translate or transcode the mediacontent according to the differences between the characteristics of theenvironment of the source device 512, 516 and the characteristics of theenvironment of the recipient device 506, 514. The recipient device 506,514 can modify the format of the media content, can change the encodingscheme used for the media content, or can alter the media content toaccount for the detected environment differences when the media contentpresented by or on the recipient device 506, 514. In one embodiment, thesource device 512, 516 can be presenting a live cam video feed of aflock of penguins in Antarctica to a user who is riding on a subwaytrain. The user of the source device 512, 516 decides to share thistelevision show with a user of a recipient device 506, 514. Therecipient device 506, 514 can be presenting, at the same time, a virtualreality application where the user of the recipient device 506, 514 is“living” in a virtual city. The user of the recipient device 506, 514can be attending a football game in the virtual-reality city. Ascoreboard at the virtual football game can be used to display video.Various physical world phenomena at the source device 512, 516 can beretrieved by the recipient device 506, 514 as sensory datacharacterizing the source device environment. The recipient device 506,514 can detect differences between the source and recipient devices. Inone embodiment, the recipient device 506, 514 can transcode the mediacontent from the source device 512, 516 to work in the virtualenvironment by converting from a streaming video format to an embeddedvideo format, such as Flash™ video, a trademark of the Adobe Corporationof San Jose, Calif.

In another illustration, the media content can be in the form of contentof a virtual reality world being presented on the source device 512,516. In one embodiment, the source device 512, 516 can be presenting avirtual reality application where an avatar of a user “lives” in ahouse. The house can have elements of home décor such as paintings, wallcolors, and landscaping. The user decides to share her home in hervirtual reality application with a user of the recipient device 506,514, who is also a “resident” in a virtual reality application. In thecontext of the virtual reality application, the décor elements can beidentified as characteristics of the environment of the user of thesource device 512, 516. Therefore, the recipient device 506, 514 canreceive the décor elements as characteristics of the source devicevirtual environment and compare these characteristics to the virtualenvironment of the recipient device 506, 514. The user of the recipientdevice 506, 514 can have different décor—paintings, colors,landscaping—at his house. The recipient device 506, 514 can detect thesedifferences and alter the content of the first user's house, aspresented to the second user at the recipient device 506, 514. Therecipient device 506, 514 can translate the first house by substitutingpart of the content of the second house (to make the second user feelmore at home in his friend's house).

If the media device detects a user movement in step 1010, then the mediadevice can capture video of the user movement at the media device instep 1012. In step 1014, the media device can compare the captured videoof the user movement at the media device. If the media device identifiesa gesture from the captured video of the user movement by imagerecognition in step 1016, then the media device can retrieve a commandto the media device corresponding to the identified gesture in step1102. In step 1104, the media device can select a second modification ofthe user interface of the media presentation element to modify thepresentation of the media content according to the command to the mediadevice.

FIGS. 12-13 depict an illustrative method 1200 that can operate inportions of the devices of FIGS. 1-6. Method 1200 can begin with step1202 in which a recipient device 506, 514 can receive media content froma source device 512, 516. The media content from the source device 512,516 can include metadata corresponding to a digital representation of anenvironment 542, 546 of the source device 512, 516. The sensory datarepresenting the environment of the source device 512, 516 can beincluded with the media content as metadata. The metadata can provideinformation on the media content. In this case, the metadata cancorrespond to sensory data collected for an environment of the sourcedevice 512, 516, where the environment can be a physical or virtualenvironment a user of the source device would experience as part of themedia content. For example, the temperature at the source device can bemeasured and saved. A user would experience the collected temperatureswhile viewing media content at the source device. A metadata descriptorof labeled “average temperature” can be created, or tagged, tocorrespond to a calculated mean value for the collected temperaturereadings taken at the source device. Similarly, a metadata descriptor of“hourly temperatures” can be tagged to correspond to each hourly valueof the set of collected temperatures. Tagging the various sensory datameasurement into metadata can be used to provide an infrastructure forsending and receiving the sensory data in a standardized format alongwith the media content.

If the media content can be streamed from the source device 512, 516 tothe server 530 or to the recipient device 506, 514, the tagged metadatacan be included within a header, or overhead, section of the datastream. If the media content is sent from the source device 512, 516 tothe server 530 or the recipient device 506, 514 as a discrete file orseries of files, the metadata can be included as a part of one or moreof the files or as a separate file. By sending the metadata within themedia content data structure, the metadata is automatically includedwith the media content. Error detection and/or correction techniques,applicable to the streaming or file-based media content data, can beautomatically applied on the metadata.

The metadata can be defined as a series of data fields or elementsincluded in an overhead section or file of the media content data. Themetadata can be included with the media content using metadatacontainers which can encapsulate a set of metadata as a group. Themetadata containers can be defined according to standard formats, suchas the American National Standards Institute (ANSI) standard. Theenvironmental metadata can be included in metadata containers along withother metadata elements associated with media content. For example, themetadata for the sensory data can be included with metadata storinginformation on copyright owner, artist, data, or genre of the mediacontent. The metadata can be included as encoded data. The metadata canbe encrypted.

Individual metadata elements can be used to create a digitalrepresentation of the overall environment of the source device 512, 516.For example, the metadata descriptors for temperature, such as averagetemperature and hourly temperature, can be combined with similarmetadata descriptors for time of day, date, location, color, locationdetails, and other data collected from the physical or virtualenvironment. The combination of several or all of the metadatadescriptors can be used to establish a digital environment for thesource device 512, 516. That is, the set of metadata can provide acombination of environmental factors sufficient to describe an overallsource device environment. The set of metadata descriptors can bedescribed as a digital representation, or digital model, of theenvironment. When the set of metadata is sent along with the mediacontent, a digital representation of the environment of the sourcedevice 512, 516 is thereby provided within the media content.

In step 1204, the recipient device 506, 514 can retrieve sensoryinformation from an environment 544, 548 of the recipient device. Thesensory information can represent a physical world or a virtual world ofthe recipient device. The sensory information can be collected by meanssimilar to the sensory data of the source device 512, 516, as describedabove. For example, the recipient device 506, 514 can capturetemperature data by way of a temperature probe or can capture video databy way of a camera, as described above

In step 1206, the recipient device 506, 514 can identify a digitalrepresentation of the environment of the recipient device 506, 514corresponding to the sensory information from the environment 544, 548of the recipient device. As with the source device 512, 516, therecipient device 506, 514 can tag sensory data measured at the recipientdevice into metadata descriptors. Tagging the sensory data to metadatacan allow the recipient device 506, 514 to share the environmental datawith other devices in the same metadata format as used by the sourcedevice 512, 516. For example, the recipient device can determine a meanvalue or a range of values for temperature based on captured temperaturedata. In another example, the recipient device can convert capturedvideo into a standard file format or into a series of still images. Therecipient device 506, 514 can then use a set of all of the metadatadescriptors to establish a digital environment for the recipient device506, 514. That is, the set of metadata can provide a combination ofenvironmental factors sufficient to describe an overall recipient deviceenvironment. The set of metadata descriptors can be described as adigital representation, or digital model, of the recipient deviceenvironment.

In step 1208, the recipient device 506, 514 can determine differencesbetween the digital representation of the environment of the sourcedevice 512, 516 and the digital representation of the environment of therecipient device. The recipient device 506, 512 can compare a set ofmetadata collected from the environment of the source device 512, 516with a set of sensory information collected the environment of therecipient device. The recipient device 506, 514 can compare, forexample, a physical environment at the source device 512, 516 with aphysical environment at the recipient device 506, 514 by comparing themetadata descriptors from each device. For example, the source device512, 516 may report bright lighting conditions, such a sunshine, asexhibited by lighting intensity sensory data. By comparison, therecipient device 506, 514 may have identified low-level lightingconditions based on a cloudy day or nighttime or poor indoor lighting.The recipient device 506, 514 can compare the lighting conditions aslike categories and detect the differences. Similarly, the recipientdevice 506, 514 can compare all of the other reported or identifiedphysical sensory data for the two devices, such as temperature,background audio, location, and the like.

In step 1209, the recipient device 506, 514 can select a firstmodification of a presentation of the media content according todifferences between the digital representation of the environment of thesource device 512, 516 and the digital representation of the environmentof the recipient device 506, 514. In one embodiment, the recipientdevice 506, 514 can adapt a user interface 404 of the recipient device506, 514 according to a difference, or combination of differences,between the digital representations of the environments of the sourcedevice 512, 516 and the recipient device. In one embodiment, therecipient device 506, 514 can modify the user interface 404 to accountfor differences between physical and virtual worlds or between twovirtual worlds. In one embodiment, the recipient device 506, 514 cantranslate or transcode the media content according to the differencesbetween the digital representation of the environment of the sourcedevice 512, 516 and the digital representation of the environment of therecipient device 506, 514 in step 916.

If the media device can detect a user movement in step 1210, then themedia device captures video of the user movement at the media device instep 1212. In step 1214, the media device can compare the captured videoof the user movement at the media device. If the media device canidentify a gesture from the captured video of the user movement by imagerecognition in step 1216, then the media device can retrieve a commandto the media device corresponding to the identified gesture in step1302. In step 1304, the media device selects a second modification ofthe presentation of the media content according to the command to themedia device.

FIGS. 14-15 depict an illustrative method 1400 that can operate inportions of the devices of FIGS. 1-6. Method 1400 can begin with step1402 in which a recipient device 604 can detect a sensor data source 614for remotely capturing sensory data from a physical environment of therecipient device. In step 1404, the recipient device 604 can receivefrom a sensor data source 614, 624, and 634 sensory informationrepresenting the sensory data from the physical environment of therecipient device. In one embodiment, a media processor device 604 and644, such as the recipient device 604 or a source device 644, can detecta sensor data source 614, 624 and 634 capable and willing to sharesensory data that has been captured by the sensor data source in thesame environment as the source device or recipient device. In oneembodiment, the media processor device 604 and 644 can broadcast arequest for sensory data to any sensor data sources 614, 624 and 634 inthe same environment as the media processor device. In one embodiment,the request can be a radio frequency message. The media processor device604 can send out a message using, for example, short range radiofrequency in the scientific, medical, and industrial (SFI) band. Themedia processor device 604 and 644 can send the message on Wi-Fi orBluetooth communications link. In one embodiment, the media processordevice 604 and 644 can send out a radio frequency signal capable ofreading passive radio frequency identification (RFID) tags on the sensordata sources 614, 624 and 634.

In one embodiment, the media processor device 604 and 644 can send arequest message over a cellular network, a wired network, or an internetprotocol capable network. The request message can include informationidentifying the media processor device 604 and 644. In one embodiment,the request message can include a media access control (MAC) address ofthe media processor device. The request message can further includeinformation to identify a service provider of the media processor device604 and 644. The request message can further include information toidentify a group that is sharing sensory data. The request message canfurther include information to identify a specific type or identity ofsensory data needed by the media processor device 604 and 644 or if themedia processor device will accept any available data from a sensor datasource 614, 624 and 634. The request message can be in the form of arequest to create a communications link between the media processordevice 604 and 644 and an available sensor data source 614, 624 and 634or the message can be a continuation of communications from an alreadyestablished link.

In one embodiment, the media processor device 604 and 644 can receive aresponse sent from any of the sensor data sources 614, 624 and 634offering the sensory data. The response can include information aboutthe capabilities of the sensor data sources 614, 624 and 634, theirrespective locations, their service provider, whether they areauthorized to share sensory data, or any other relevant informationwhich can be useful to the media processor device 604 and 644. Theresponse can be sent and received over the same medium as was used bythe media processor device 604 and 644 to send the request message. So,for example, the media processor device 604 and 644 can send a requestmessage by way of short range RF communication. The sensor data sources614, 624 and 634 then responds via the same short range RF. The responsecan be sent by way of a different medium. For example, where the mediaprocessor device 604 and 644 sends a request message that is capable ofreading a RFID tag, the response can be a combination of the RFIDreading (identifying the sensor data sources 614, 624 and 634) and amessage in another medium, such as short range RF that includes furtherinformation on a specific sensor data source 614, 624 and 634.

The sensory information can simply be a digital data reading from asensor 616, 626 and 636. The sensory information can be a set of datareadings, such as several different types of sensory data collected by asingle sensor data source 614, 624 and 634 or a series of data pointsfor a single specific sensory data type that have been collected overtime. The sensory information can be the products of a statisticalanalysis of sensory data readings, such as an average value or aweighted average or a moving average.

In one embodiment, a sensor data source 614, 624 and 634 broadcasts anoffer of sensory data to any media processor device 604 and 644 nearby.The request can be a radio frequency message. The sensor data source614, 624 and 634 can send out a message using, for example, short rangeradio frequency band, Wi-Fi, or Bluetooth. In one embodiment, the sensordata source 614, 624 and 634 can send out a radio frequency signalcapable of reading passive radio frequency identification (RFID) tags onthe media processor device 604 and 644.

The sensor data source 614, 624 and 634 can send the message over acellular network, a wired network, or an internet protocol capablenetwork. The request message can include information identifying thesensor data source 614, 624 and 634. In one embodiment, the requestmessage can include a media access control (MAC) address of the sensordata source 614, 624 and 634. The request message can further includeinformation to identify a service provider of the sensor data source614, 624 and 634. The request message can further include information toidentify a group that is sharing sensory data. The request message canfurther include information to identify a specific type or identity ofsensory data offered by the sensor data source 614, 624 and 634. Therequest message can be in the form of a request to create acommunications link between the sensor data source 614, 624 and 634 andany available media processor device 604 and 644 or the message can be acontinuation of communications from an already established link.

In one embodiment, any of the media processor devices 604 and 644 cansend a response to the offering sensor data source 614, 624 and 634accepting the offer of the sensory data. The acceptance response can besent and received over the same medium as was used by the sensor datasource 614, 624 and 634 to send the offering message. So, for example,the sensor data source 614, 624 and 634 can send a message offeringsensory data by way of short range RF communication. The media processordevice 604 and 644 can then respond via the same short range RF.Alternatively, the response can be sent by way of a different medium.For example, where the sensor data source 614, 624 and 634 sends arequest message that is capable of reading a RFID tag, the response canbe a combination of the RFID reading (identifying the media processordevice 604 and 644) and a message in another medium, such as short rangeRF that includes further information on a media processor device 604 and644.

In one embodiment, the media processor device 604 and 644 can receivesensory information representing sensory data from the sensor datasource 614, 624 and 634. The sensory information can simply be a digitaldata reading from a sensor 616, 626 and 636. The sensory information canbe a set of data readings, such as several different types of sensorydata collected by a single sensor data source 614, 624 and 634 or aseries of data points for a single specific sensory data type that havebeen collected over time. The sensory information can be the products ofa statistical analysis of sensory data readings, such as an averagevalue or a weighted average or a moving average.

In step 1406, the recipient device 506, 514 can identify characteristicsof the physical environment of the recipient device from the receivedsensory information. The recipient device 506, 514 can identifycharacteristics of the environment of the recipient device from theretrieved sensory information. For example, the recipient device candetermine a mean value or a range of values for temperature based oncaptured temperature data. The recipient device can convert capturedvideo into a standard file format or into a series of still images.

In step 1407, the recipient device 506, 514 can receive from a sourcedevice 512, 516 media content and sensory information representingcharacteristics of an environment of the source device. In step 1408 therecipient device can determine at least one difference between thecharacteristics of the environment of the source device andcharacteristics of the physical environment of the recipient device. Instep 1409, the recipient device can select a first modification of apresentation of the media content according to the at least onedifference between the plurality of characteristics of the environmentof the source device and the plurality of characteristics of thephysical environment of the recipient device.

If the media device detects a user movement in step 1410, then the mediadevice can capture video of the user movement at the media device instep 1412. In step 1414, the media device can compare the captured videoof the user movement at the media device. If the media device identifiesa gesture from the captured video of the user movement by imagerecognition in step 1501, then the media device can retrieve a commandto the media device corresponding to the identified gesture in step1502. In step 1504, the media device can select a second modification ofthe presentation of the media content according to the command to themedia device.

Upon reviewing the aforementioned embodiments, it would be evident to anartisan with ordinary skill in the art that said embodiments can bemodified, reduced, or enhanced without departing from the scope andspirit of the claims described below. In one embodiment, the mediadevice 506, 512 can use object recognition applications to compare knownpatterns, objects, shapes, sounds, and/or places that appear in thevideo, audio, or still image content reported or identified as being ofthe source device 512, 516 and/or the recipient device 506, 514. Bycomparing recognized objects, patterns, shapes, sounds, and/or places,differences in the environments of the source device 512, 516 and therecipient device 506, 514 can be determined to guide modification of themedia content or of the user interface of the recipient device 506, 514.In one embodiment, a media device 506, 512 can further be adapted todetect a voice command and to combine the detected voice command with adetected gesture-based command. In another embodiment, the media device506, 512 can be further adapted to provide a set of custom gestures toanother media device or to a server 530. In another embodiment, themedia device 506, 512 can be adapted to include a gestures-off statewhere capture of video data of the user is turned off.

FIG. 16 depicts an exemplary diagrammatic representation of a machine inthe form of a computer system 1600 within which a set of instructions,when executed, may cause the machine to perform any one or more of themethods discussed above. One or more instances of the machine canoperate, for example, as the server 503, the media processor 506, thedisplay 508, computing devices 512, mobile devices 514, or combinationsthereof as described above. In some embodiments, the machine may beconnected (e.g., using a network) to other machines. In a networkeddeployment, the machine may operate in the capacity of a server or aclient user machine in server-client user network environment, or as apeer machine in a peer-to-peer (or distributed) network environment.

The machine may comprise a server computer, a client user computer, apersonal computer (PC), a tablet PC, a smart phone, a laptop computer, adesktop computer, a control system, a network router, switch or bridge,or any machine capable of executing a set of instructions (sequential orotherwise) that specify actions to be taken by that machine. It will beunderstood that a communication device of the present disclosureincludes broadly any electronic device that provides voice, video ordata communication. Further, while a single machine is illustrated, theterm “machine” shall also be taken to include any collection of machinesthat individually or jointly execute a set (or multiple sets) ofinstructions to perform any one or more of the methods discussed herein.

The computer system 1600 may include a processor 1602 (e.g., a centralprocessing unit (CPU), a graphics processing unit (GPU, or both), a mainmemory 1604 and a static memory 1606, which communicate with each othervia a bus 1608. The computer system 1600 may further include a videodisplay unit 1610 (e.g., a liquid crystal display (LCD), a flat panel,or a solid state display. The computer system 1600 may include an inputdevice 1612 (e.g., a keyboard), a cursor control device 1614 (e.g., amouse), a disk drive unit 1616, a signal generation device 1618 (e.g., aspeaker or remote control) and a network interface device 1620.

The disk drive unit 1616 may include a tangible computer-readablestorage medium 1622 on which is stored one or more sets of instructions(e.g., software 1624) embodying any one or more of the methods orfunctions described herein, including those methods illustrated above.The instructions 1624 may also reside, completely or at least partially,within the main memory 1604, the static memory 1606, and/or within theprocessor 1602 during execution thereof by the computer system 1600. Themain memory 1604 and the processor 1602 also may constitute tangiblecomputer-readable storage media.

Dedicated hardware implementations including, but not limited to,application specific integrated circuits, programmable logic arrays andother hardware devices can likewise be constructed to implement themethods described herein. Applications that may include the apparatusand systems of various embodiments broadly include a variety ofelectronic and computer systems. Some embodiments implement functions intwo or more specific interconnected hardware modules or devices withrelated control and data signals communicated between and through themodules, or as portions of an application-specific integrated circuit.In one embodiment, therefore, it is applicable to software, firmware,and hardware implementations.

In accordance with various embodiments of the present disclosure, themethods described herein are intended for operation as software programsrunning on a computer processor. Furthermore, software implementationscan include, but not limited to, distributed processing orcomponent/object distributed processing, parallel processing, or virtualmachine processing can also be constructed to implement the methodsdescribed herein.

While the tangible computer-readable storage medium 1622 is shown in anexample embodiment to be a single medium, the term “tangiblecomputer-readable storage medium” should be taken to include a singlemedium or multiple media (e.g., a centralized or distributed database,and/or associated caches and servers) that store the one or more sets ofinstructions. The term “tangible computer-readable storage medium” shallalso be taken to include any non-transitory medium that is capable ofstoring or encoding a set of instructions for execution by the machineand that cause the machine to perform any one or more of the methods ofthe present disclosure.

The term “tangible computer-readable storage medium” shall accordinglybe taken to include, but not be limited to: solid-state memories such asa memory card or other package that houses one or more read-only(non-volatile) memories, random access memories, or other re-writable(volatile) memories, a magneto-optical or optical medium such as a diskor tape, or other tangible media which can be used to store information.Accordingly, the disclosure is considered to include any one or more ofa tangible computer-readable storage medium, as listed herein andincluding art-recognized equivalents and successor media, in which thesoftware implementations herein are stored.

Although the present specification describes components and functionsimplemented in the embodiments with reference to particular standardsand protocols, the disclosure is not limited to such standards andprotocols. Each of the standards for Internet and other packet switchednetwork transmission (e.g., TCP/IP, UDP/IP, HTML, HTTP) representexamples of the state of the art. Such standards are from time-to-timesuperseded by faster or more efficient equivalents having essentiallythe same functions. Wireless standards for device detection (e.g.,RFID), short-range communications (e.g., Bluetooth, WiFi, Zigbee), andlong-range communications (e.g., WiMAX, GSM, CDMA) are contemplated foruse by computer system 1600.

The illustrations of embodiments described herein are intended toprovide a general understanding of the structure of various embodiments,and they are not intended to serve as a complete description of all theelements and features of apparatus and systems that might make use ofthe structures described herein. Many other embodiments will be apparentto those of skill in the art upon reviewing the above description. Otherembodiments may be utilized and derived therefrom, such that structuraland logical substitutions and changes may be made without departing fromthe scope of this disclosure. Figures are also merely representationaland may not be drawn to scale. Certain proportions thereof may beexaggerated, while others may be minimized. Accordingly, thespecification and drawings are to be regarded in an illustrative ratherthan a restrictive sense.

Although specific embodiments have been illustrated and describedherein, it should be appreciated that any arrangement calculated toachieve the same purpose may be substituted for the specific embodimentsshown. This disclosure is intended to cover any and all adaptations orvariations of various embodiments. Combinations of the aboveembodiments, and other embodiments not specifically described herein,will be apparent to those of skill in the art upon reviewing the abovedescription.

The Abstract of the Disclosure is provided with the understanding thatit will not be used to interpret or limit the scope or meaning of theclaims. In addition, in the foregoing Detailed Description, it can beseen that various features are grouped together in a single embodimentfor the purpose of streamlining the disclosure. This method ofdisclosure is not to be interpreted as reflecting an intention that theclaimed embodiments require more features than are expressly recited ineach claim. Rather, as the following claims reflect, inventive subjectmatter lies in less than all features of a single disclosed embodiment.Thus the following claims are hereby incorporated into the DetailedDescription, with each claim standing on its own as a separately claimedsubject matter.

What is claimed is:
 1. A media device, comprising: a memory that storesexecutable instructions; a media presentation element to present mediacontent; and a processor coupled to the memory and the mediapresentation element, wherein the processor, responsive to executing theexecutable instructions, performs operations comprising: identifyingfirst characteristics of a first environment of the media deviceaccording to first sensory information, wherein the first sensoryinformation comprises an ambient condition of a space in which the mediadevice operates; identifying second characteristics of a secondenvironment of a source device according to descriptive information,wherein the source device provides the media content; determining adifference between the first characteristics of the first environmentand the second characteristics of the second environment; selecting afirst adaptation to modify a presentation of the media content by themedia presentation element according to the difference; modifying thepresentation of the media content by the media presentation elementaccording to the first adaptation to generate a first modifiedpresentation of the media content; identifying a command from a seriesof gestures of user movement; selecting a second adaptation to modifythe presentation of the media content at the media presentation elementaccording to the command; and modifying the first modified presentationof the media content according to the second adaptation to generate asecond modified presentation of the media content.
 2. The media deviceof claim 1, wherein the operations further comprise: identifying theseries of gestures from captured video of the user movement by imagerecognition; and comparing the series of gestures to a plurality ofpredetermined gestures, wherein each of the plurality of predeterminedgestures corresponds to a predetermined command of a plurality ofpredetermined commands.
 3. The media device of claim 2, wherein themedia content, the plurality of predetermined gestures, and theplurality of predetermined commands are provided by a service providerby way of a communication system that is communicatively coupled to themedia device.
 4. The media device of claim 2, wherein the plurality ofpredetermined gestures comprise one of a navigation gesture, a retrievalgesture, a drawing gesture, a disposal gesture, or a combinationthereof.
 5. The media device of claim 1, wherein the operations furthercomprise comparing the series of gestures to a plurality of customgestures created at the media device.
 6. The media device of claim 5,wherein individual commands corresponding to individual gestures of theseries of gestures are different from the command.
 7. The media deviceof claim 1, wherein the series of gestures comprises an undisclosedgesture created at the media device, wherein the undisclosed gesturecorresponds to an undisclosed command, and wherein the undisclosedcommand is associated with a process comprising one of a process tologin at the media device, a process to disable a presentation at themedia device, a process to shut down the media device, a process tocommunicate privately between the media device and a second device, or acombination thereof.
 8. The media device of claim 1, wherein the firstenvironment of the media device comprises a virtual environment.
 9. Anon-transitory machine-readable storage medium, comprising executableinstructions that, when executed by a processor, cause the processor toperform operations comprising: receiving media content from a sourcedevice; determining a first characteristic of a first environmentaccording to sensory information indicating an ambient condition of afirst space in which one of the processor or the source device operates;determining a second characteristic of a second environment comprisingan ambient condition of a second space in which another one of theprocessor or the source device operates; determining a differencebetween the first characteristic of the first environment and the secondcharacteristic of the second environment; modifying the media content togenerate first updated media content according to the difference;identifying a single command corresponding to a series of gesturesdetermined from images of user movement; and modifying the first updatedmedia content according to the single command to generate second updatedmedia content.
 10. The non-transitory machine-readable storage medium ofclaim 9, wherein the series of gestures correspond to a plurality ofpredetermined gestures, and wherein the single command corresponds toone of a plurality of predetermined commands.
 11. The non-transitorymachine-readable storage medium of claim 10, wherein the plurality ofpredetermined gestures and the plurality of predetermined commands aresupplied by a communication system as a gesture and command library. 12.The non-transitory machine-readable storage medium of claim 10, whereinthe plurality of predetermined gestures comprise one of a navigationgesture, a retrieval gesture, a drawing gesture, a disposal gesture, ora combination thereof.
 13. The non-transitory machine-readable storagemedium of claim 9, wherein the operations further comprise: retrieving amodification profile according to the single command; and updating thefirst updated media content according to the modification profile. 14.The non-transitory machine-readable storage medium of claim 9, wherein amessage corresponding to the series of gestures is not displayed by theprocessor.
 15. A method, comprising: receiving, by a recipient devicecomprising a processor, media content supplied by a source device;determining, by the recipient device, a first characteristic of a firstenvironment according to sensory information indicating an ambientcondition of a first space in which one of the processor or the sourcedevice operates; determining, by the recipient device, a secondcharacteristic of a second environment comprising an ambient conditionof a second space in which another one of the processor or the sourcedevice operates; determining, by the recipient device, a differencebetween the first characteristic of the first environment and the secondcharacteristic of the second environment; modifying, by the recipientdevice, the media content to generate first updated media contentaccording to the difference; identifying, by the recipient device, asingle command from a series of gestures determined from images; andmodifying, by the recipient device, the first updated media content togenerate second updated media content according to the single command.16. The method of claim 15, wherein the first environment is a virtualenvironment for presenting the media content.
 17. The method of claim15, wherein the series of gestures comprises one of a navigationgesture, a retrieval gesture, or a combination thereof.
 18. The methodof claim 15, further comprising comparing, by the recipient device, theseries of gestures to a plurality of gestures to identify the singlecommand from a corresponding plurality of commands.
 19. The method ofclaim 15, wherein a message corresponding to the series of gestures isnot displayed by the processor.
 20. The method of claim 15, wherein theseries of gestures comprises one of a drawing gesture, a disposalgesture, or a combination thereof.